Solving KKT Systems via the Trust Region and the Conjugate Gradient Methods
نویسندگان
چکیده
In this paper, we propose a trust region method for solving KKT systems arising from the variational inequality problem and the constrained optimization problem. The trust region subproblem is derived from reformulation of the KKT system as a constrained optimization problem and is solved by the truncated conjugate gradient method; meanwhile the variables remain feasible with respect to the constrained optimization problem. Global and superlinear convergence are established. Some preliminary numerical experiments show that the method is quite promising.
منابع مشابه
A Three-terms Conjugate Gradient Algorithm for Solving Large-Scale Systems of Nonlinear Equations
Nonlinear conjugate gradient method is well known in solving large-scale unconstrained optimization problems due to it’s low storage requirement and simple to implement. Research activities on it’s application to handle higher dimensional systems of nonlinear equations are just beginning. This paper presents a Threeterm Conjugate Gradient algorithm for solving Large-Scale systems of nonlinear e...
متن کاملNumerical solution of KKT systems in PDE-constrained optimization problems via the affine scaling trust-region approach
A recently proposed trust-region approach for bound-constrained nonlinear equations is applied to the KKT systems arising from the discretization of a class of PDE-constrained optimization problems. Two different implementations are developed that take into account the large dimension and the special structure of the problems. The linear algebra phase is analyzed considering the possibility of ...
متن کاملOn Efficiency of Non-Monotone Adaptive Trust Region and Scaled Trust Region Methods in Solving Nonlinear Systems of Equations
In this paper we run two important methods for solving some well-known problems and make a comparison on their performance and efficiency in solving nonlinear systems of equations. One of these methods is a non-monotone adaptive trust region strategy and another one is a scaled trust region approach. Each of methods showed fast convergence in special problems and slow convergence in other o...
متن کاملA New Convergence Theory for Trust-Region Algorithm for Solving Constrained Optimization Problems
In this paper, we propose a new trust-region algorithm for solving a constrained optimization problem with equality and inequality constraints. In this algorithm, an active-set technique is used to convert the constrained optimization problem with equality and inequality constraints to equality constrained optimization problem. A projected Hessian technique is used together with a conjugate gra...
متن کامل